Combining first and second image data of an object

ABSTRACT

The invention relates to a method of combining first and second image data of an object ( 3 ), wherein the first image data of the object ( 3 ) are repeatedly generated by an ultrasound detector ( 1 ), wherein the second image data of the object ( 3 ) are generated separately, for example the second image data have been recorded earlier by a computer tomography, a magnetic resonance or a positron emission tomography imaging device, wherein the first image data are transferred from the ultrasound detector ( 1 ) to a combination device ( 5 ) and wherein the combination device ( 5 ) is adapted to combine the first and second image data of the object ( 3 ).  
     Geometry data is transferred in addition to the first image data from the ultrasound detector ( 1 ) to the combination device ( 5 ), wherein the geometry data comprise information for establishing a link between the geometry of the first image data and the geometry of the second image data.

BACKGROUND OF THE INVENTION

The invention relates to an apparatus and a method for/of combiningfirst and second image data of an object. An ultrasound (US) detectorrepeatedly generates the first image data of the object and the secondimage data of the object are generated separately. In the apparatus,means for storing and/or receiving the second image data of the object(such as an image data storage and/or an interface) are provided. Forexample, the second image data may have been recorded earlier by acomputer tomography (CT), a magnetic resonance (MR), a positron emissiontomography (PET), an X-ray and/or a three-dimensional (3D) US imagingdevice. In particular, any 3D image information can be used as thesecond image data. A combination device combines the first and secondimage data of the object. The combined image data may be displayed inseparate areas of a screen and/or may be superimposed on a screen. Moreparticularly, the invention may be applied in the field of stereographicdiagnosis concerning human or animal bodies, but also concerningmaterial research and/or material examination.

Ultrasound detectors are comparatively easy to handle and are able todeliver image information quasi-continuously and, approximately, inreal-time. However, in many applications, other imaging technologies(such as the ones mentioned above) provide better results. Therefore, ithas been proposed earlier to combine image information of betterquality, which has been recorded earlier, with real-time ultrasoundimage information.

In the scientific publication of Pagoulatos et al.: “Interactive 3-DRegistration of Ultrasound and Magnetic Resonance Images Based on aMagnetic Position Sensor”, published in IEEE TRANSACTIONS ON INFORMATIONTECHNOLOGY IN BIOMEDICINE, VOL. 3, NO. 4, December 1999, describes anapparatus of the type mentioned above. It is proposed in the publicationto use an MR imaging device and to register the imaging object relativeto the MR imaging device. The term “register” means that the geometry ofthe object and the coordinate system of the MR imaging device arebrought into a defined relation. The apparatus comprises a positionsensor, which is firmly coupled to an ultrasound probe. Using theposition sensor and due to the fact that its relative position to theultrasound probe does not vary, it is possible to track the position andthe orientation of the ultrasound probe. However, it is necessary tocalibrate the position sensor relative to the ultrasound probe and toregister the imaging object relative to the coordinate system of theultrasound probe. As a result, the MR imaging information and theultrasound imaging information can be combined.

Using systems of the type described before, it is possible to display MRimage information of the same orientation and/or scaled in the samemanner as the most recent US image. In other words: it can be simulatedthat the MR image is recorded in real-time, provided that the image dataprocessing is fast enough.

However, the various calibration and registration procedures aretime-consuming and need to be performed with care in order to obtaingood results. For example, the position of a set of landmarks on thesurface of the object and/or anatomical markers (in case of a human oranimal body) is to be detected during registration.

Furthermore, modern US systems enable the user to vary the penetrationdepth of the US image in the object and/or to change the ultrasoundprobe. As a consequence, the calibration of the position sensor relativeto the ultrasound probe and the registration of the imaging objectrelative to the coordinate system of the ultrasound probe are no longervalid.

There are prior art ultrasound devices with pre-calibrated pixel sizeswherein the pixel size can be varied by the user. However, onlystep-like increases or decreases of the pixel size (or of a spatialdimension of the ultrasound image) can be performed with these prior artdevices.

U.S. Pat. No. 6,546,279 B1 discloses a method and an arrangement forlocating, vectoring and inserting a needle-like medical device towardand into a targeted patient anatomic feature while the patient is beingimaged with multi-modality medical imaging equipment. In the secondembodiment of the document at least a portion of the patient is imagedwith a first imaging technique (such as computed tomography) to providea first set of imaging data, which has a fixed frame of reference.Ultrasound imaging data is obtained. The ultrasound imaging data is notfixed relative to the fixed frame of reference. Position data isdetermined for the ultrasound device. Using the determined position dataand the ultrasound imaging data, a converted set of imaging data isprovided which is referenced to the fixed frame of reference.

The publication “sensor fusion for surgical applications” by JimLeonhard (15^(th) Annual AESS/IEEE Dayton Section Symposium. Sensing theworld: Analog sensors and systems across the spectrum (Cat. No.98EX178), pages 37-44, XP002253643, New York, N.Y., USA, IEEE, USA)discloses a surgical navigation system which combines preoperate 3dimagery and intra-operate localisation to register a patient.

US 2002/0128550 A1 discloses a diagnostic imaging system. Magneticresonance image and ultrasound images are registered in a commonreference frame.

It is an object of the present invention to provide an apparatus and amethod of the type indicated above, which allow lessening the effects ofthe disadvantages mentioned before, which facilitate the handling by theuser and which allow using a greater variety of features of theultrasound system without loosing time for calibration and/orregistration. In particular, it is desirable to adjust the settings ofthe ultrasound system and/or to change the ultrasound probe and tocontinue with the ultrasound imaging process without interruption.

SUMMARY OF THE INVENTION

A method is provided of combining first and second image data of anobject, wherein the first image data of the object are repeatedlygenerated by an ultrasound detector, wherein the second image data ofthe object are generated separately, wherein the first image data aretransferred from the ultrasound detector to a combination device andwherein the combination device is adapted to combine the first andsecond image data of the object. Geometry data is transferred inaddition to the first image data from the ultrasound detector to thecombination device.

In particular, the geometry data comprise information for establishing alink between the geometry of the first image data and the geometry ofthe second image data.

Preferably, the geometry data are transferred directly from theultrasound detector to the combination device, e.g. via an additionalcable which connects the detects and the device.

Further, an apparatus is provided for combining first and second imagedata of an object, the apparatus comprising an ultrasound detector forrepeatedly generating the first image data of the object; means forstoring and/or receiving the second image data of the object; acombination device which is adapted to combine the first and secondimage data of the object; and an image data connection from theultrasound detector to the combination device for transferring the firstimage data. The ultrasound detector is connected to the combinationdevice by a geometry data connection, wherein the geometry dataconnection, the ultrasound detector and the combination device areadapted to transfer geometry data additionally to the first image datafrom the ultrasound detector to the combination device.

The geometry data may, for example, comprise information forestablishing a link between the geometry of the first image data and thegeometry of the second image data. The “link” (or, in other words, aprocessable relation between the first and the second image data)allows, for example, the determination of an overlapping region of afirst image represented by the first image data and of a second imagerepresented by the second image data. According to a preferredapplication, the combination device continuously displays a first imageof the object corresponding to the repeatedly generated first image dataand continuously displays a second image of the object corresponding tothe second image data, wherein the orientation and/or scaling of atleast a part of the object is identical in the first and in the secondimage. In particular, the second image data may be displayed, as if thesecond image data have repeatedly been recorded instead of or inaddition to the first image data.

As a consequence of the fact that the geometry data are available to thecombination device, the effort for re-calibrating the ultrasounddetector relative to a tracking sensor (if any) and/or forre-registrating the object relative to the coordinate system of theultrasound detector can be reduced or eliminated.

The geometry data may comprise one or more than one of the followingtype of information. In particular, any combination and/or aggregationof the following type of information can be included in the geometrydata:

-   -   a) information concerning at least one spatial dimension of an        image unit of the first image data, in particular of a pixel        (preferably separately for different directions of a coordinate        system);    -   b) information concerning an image position of at least a part        of an image, which is represented by the first image data,        relative to a reference point of the ultrasound detector or        relative to a reference point or reference object in the        ultrasound image. This information is particularly useful, if a        user can adjust a zoom factor of the ultrasound image. For        example, this information comprises a distance in image units        (e.g. pixels). In combination with the scaling information of        item a), the distance may be defined in cm or another unit of        length;    -   c) information concerning an orientation of the ultrasound image        relative to a reference point or a reference object of the        ultrasound detector (in particular an ultrasound probe of the        detector). For example, this information may comprise the        orientation of at least one axis of a coordinate system of the        ultrasound image;    -   d) information concerning a region or an area, which is actually        covered by an ultrasound image that is represented by the first        image data; and    -   e) information concerning a detector position of the ultrasound        detector relative to a position sensor for determining a        location and/or an orientation of the ultrasound detector.        Instead of or in addition to a position sensor, a signal source        may be coupled to the ultrasound probe, wherein the signal can        be evaluated in order to determine the position of the probe.        For example, such information may be collected once in advance        and may be saved individually for each ultrasound probe, which        can be connected to the ultrasound system/device. In this case,        it is sufficient during operation to transfer simply an        identification signal, which enables to identify the probe that        is used. The combination device can select the respective        geometry information using the identification information. In a        specific embodiment, the information concerning the relative        position, which is transferred or saved, may be a calibration        matrix.

Preferably, all of these types of information are transferred from theultrasound detector to the combination device.

Since information concerning at least one spatial dimension of an imageunit of the first image data (e. g. the pixel size) can be transferredfrom the ultrasound device to the combination device, according to oneembodiment of the present invention, the user can choose the spatialdimension within the respective range of the ultrasound device.Consequently, a continuously adjustable pixel size can be implemented inthe ultrasound device.

The information concerning an image position relative to a referencepoint of the ultrasound detector facilitates the combination of the twodifferent types of image data and makes it possible to adjust theposition of the ultrasound image, for example by using a control knobprovided at the ultrasound probe.

The information concerning an orientation of the ultrasound imagerelative to a reference point of the ultrasound detector enable the userto change the orientation by operating a control element at theultrasound probe.

Similarly to the information concerning the pixel size, the informationconcerning a region or an area, which is actually covered by anultrasound image facilitates the combination of the ultrasound imagedata with the other image data.

According to a preferred embodiment at least a part of the geometry datais repeatedly transferred to the combination device, in particular everytime when the first image data are generated and/or when the first imagedata are transferred to the ultrasound detector. The geometry data maybe transferred on request and/or without request from the combinationdevice and/or from another part or unit (for example of a centralcontrol unit) of the apparatus.

There are further possibilities to use the additional data connectionbetween the ultrasound detector and the combination device, or to use afurther data connection. For example, a mode and/or a user setting ofthe ultrasound detector may be transferred from the ultrasound detectorto the combination device, on request or without request of thecombination device or another unit of the apparatus. E.g. a colour ofthe ultrasound image to be used in displaying the ultrasound image, arepetition frequency of the ultrasound image generation (for example inorder to give an indication to the user, if the frequency is too low)and/or information representing the object may be transferred.

If the ultrasound detector comprises a control unit for controlling animage data generation of the ultrasound detector, the control unit maybe adapted to generate at least a part of the geometry data. Forexample, the control unit can adjust a penetration depth of theultrasound image, using a velocity value of the ultrasound waves in theobject, by setting a time limit for detection of US echo signals. Inthis case, the control unit can calculate the penetration depth and cantransfer information about the penetration depth to the combinationdevice. Further, the width of an image recording area of an ultrasoundprobe may be available to the control unit for control purposes and thecontrol unit can transfer this information to the combination device.

In a preferred embodiment of the apparatus the image data connection isadapted to directly transfer the first image data in a digital formatfrom the ultrasound detector to the combination device. This saves timefor transferring the first image data and reduces costs and effort ofthe apparatus. Furthermore, the ultrasound detector, the combinationdevice and (optionally) further parts or units of an imaging system maybe integrated in one and the same device. For example, several or all ofthe units of such a device may be connected to a data bus system fortransferring data.

Generally, the image data connection and/or the geometry data connectionmay be realised by a data bus (e.g. USB or FireWire, IEEE 1394) and/ormay be part of a data network. Preferably, the embodiment of theconnection or connections shall allow displaying a first image(represented by the first image data) and a second image (represented bythe second image data) approximately in real-time of the generation ofthe first image data, for example within less than 100 ms after thegeneration. Ultrasound is particularly useful in order to generate thefirst image data, since the generation process can be performed withhigh repetition frequency (quasi-continuously). The corresponding dataconnection and the following data processing should not delay thedisplaying in way, which can be noticed by the user.

BRIEF DESCRIPTION OF THE DRAWINGS

In the following, examples and possible further features of theinvention are described by way of reference to the accompanied drawing.The embodiment shown in the FIGS. 1 to 3 and 5 represent the currentlyknown best mode of the invention. However, the invention is not limitedto the features described in the following description. The figures ofthe drawing schematically show:

FIG. 1 an arrangement 2 comprising an apparatus for combining ultrasoundimage data with a second type of data, e.g. CT image data;

FIG. 2 a more detailed view of the ultrasound detector shown in FIG. 1;

FIG. 3 a first example of an arrangement of components, which contributeto a processing of the ultrasound image data;

FIG. 4 a second example of an arrangement of components, whichcontribute to a processing of the ultrasound image data;

FIG. 5 a flow-chart of processing image data.

DETAILED DESCRIPTION

Images of an object 3 (shown in FIG. 1) are to be displayed on a screen6. An ultrasound detector 1 generates first image data of the object 3and transfers the first image data to a combination device 5 via animage data connection 10. The combination device 5 comprises a datastorage 4, which contains second image data that have previously beengenerated by a separate device (not shown in FIG. 1). The combinationdevice 5 is adapted to combine the first and second image data and todisplay them on a screen 6, which is connected to the combination device5. For example, the first and second image data may be displayedseparately on a split screen or may be superimposed. In any case, it ispreferred that a first image, which is generated using the first imagedata, and a second image, which is generated using the second imagedata, precisely show at least partially the same area or region of theobject 3 in the same orientation (angle of view) and scaling(dimensions).

The ultrasound detector 1 and the combination device 5 are connected toeach other by an additional data connection 12 for transferring geometrydata from the ultrasound detector 1 to the combination device 5. Inparticular, the geometry data connection 12 may be connected (as shownin FIG. 2) to a control unit 14 of the ultrasound detector 1.

In practice, the data connections 10, 12 may be realised by separatedata connection links or by the same data connection link. For example,a “link” may comprise a connection line, a plurality of connection linesand/or a digital data bus or bus system.

An ultrasound probe 16 (FIG. 2) of the ultrasound detector 1 is firmlycoupled to a position sensor 18 of a tracking system. The determinationof the orientation and the location of such a position sensor and,thereby, of the ultrasound probe is known in the art (see theabove-cited publication of Pagoulatos et al.). For example, magneticand/or optical (e.g. infrared) signals may be used by the trackingsystem. The position sensor 18 is connected to a tracking system controlunit 8 and the control unit 8 is connected to the combination device 5.During operation of the arrangement 2, the control unit 8 repeatedly orquasi-continuously transfers information concerning the position andconcerning the orientation of the ultrasound probe 16 to the combinationunit 5. Alternatively, this information may be transferred from the USdetector to the combination device. I.e. this information might be atleast partially included in the geometry data, which are transferred.

As shown in FIG. 2, the ultrasound device 1 may, for example, comprisean ultrasound probe 16, which is connected to the ultrasound controlunit 14 via a flexible cord 17 for transferring echo signals to thecontrol unit 14. On the other hand, the control unit 14 transferscontrol signals to the ultrasound probe via the cord 17. Also, it ispossible that at least a part of the geometry information is transferredfrom the ultrasound probe 16 to the control unit 14 and/or that at leasta part of the geometry information generated by the control unit 14 isbased on and/or derived from information, which is transferred from theultrasound probe 16 to the control unit 14. For example, the ultrasoundprobe 16 may be replaced and, therefore, transfers informationconcerning its identity to the combination device 5. In the combinationdevice 5, in an additional unit of the arrangement 2, and/or in thecombination device 5, information concerning the relative positionand/or orientation of the specific ultrasound probe 16 relative to theposition sensor 18 may be saved. For example, the ultrasound probe 16may comprise a clip for attaching the position sensor 18. Therefore, itis possible to precisely position and orientate the position sensor 18relative to the ultrasound probe 16 and to determine as well as to savethe respective geometry data in advance. After replacement of theultrasound probe 16, the identity information and the saved geometryinformation can be combined. As a consequence, it is not necessary tore-calibrate the arrangement consisting of the ultrasound detector 1 andthe position sensor 18.

An input unit 20 is connected to the ultrasound control unit 14, forexample for inputting settings of the ultrasound detector, such as apenetration depth or range of the ultrasound image. Further, the usermay change the orientation of the ultrasound image via the input unit20.

According to a preferred embodiment of the invention, the ultrasoundimage data are generated from analog signals in a unit 22 of theultrasound detector. The unit 22 may, for example, be controlled by thecontrol unit 14 (as shown in the figure), be a part of the control unit14 or be realised by a combination of the ultrasound probe 16 and thecontrol unit 14. The unit 22 is connected to an A/D-converter 24, whichconverts the analog image signal to a digital image signal. TheA/D-converter 24 is connected to an image data processing unit 26, whichis also connected to the control unit 14 or to an alternative unit ofthe ultrasound detector that transfers geometry information to the imagedata processing unit 26. Thus, the image data processing unit 26 cancombine the geometry information with the image data and/or cantransferred both information/data to a further unit (not shown in FIG.3). For example, the image data processing unit 26 may be identical toor part of the combination device 5. In this case, the image dataprocessing unit 26 also combines the first and second image informationand the unit 26 may be connected to a screen 6 (as shown in the figure).

The embodiment of FIG. 3 is of particular advantage, if the ultrasounddetector and the combination device are integrated in one device.

In an alternative arrangement, the ultrasound detector may directlygenerate digital image data, without conversion from analog to digital.

An alternative arrangement is shown in FIG. 4. The same referencenumeral denote units or devices having the same or a correspondingfunction. A D/A-converter 23 converts the digital image signal receivedvia a connection from the unit 22 or from a corresponding unit to ananalog image signal, for example to a signal in standard video format.An A/D-converter 25 that may be part of the combination device (e.g. avideo capture card) is connected to the unit 23. The unit 25 convertsthe analog signal to a digital signal, e.g. in pixel format. Then, theunit 26 processes the digital signal.

An example of processing and combining ultrasound image information isdescribed in the following with reference to FIG. 5.

In step S1, geometry information concerning the scaling of theultrasound image information are combined with the ultrasound imageinformation. For example, the ultrasound image data contains informationconcerning the intensity of image units (e.g. pixels) before step S1,but no information concerning the dimension of the image units. Thedimensional information is added by performing step S1.

In step S2, calibration information concerning the relative position ofthe ultrasound detector to the position sensor is added and/or combinedwith the information resulting from step S1. The calibration informationmay comprise as well information concerning the orientation of theultrasound image, which may be changed by the user. As a result, it isnow possible to identify the orientation and location of specific areasof the ultrasound image.

In step S3, the geometry information concerning the registration of theobject within the coordinate system of the ultrasound system or thetracking system is added.

In step S4, the ultrasound image data resulting from step S3 can becombined with the second image data.

In practice, at least some of the processing operations of steps S1 toS4 may be realised by performing a polygon scanline method, which isdescribed for example in the book “Computer Graphics. Principles andPractice.” by James D. Foley, Andries VanDam, Steven K. Feiner,published by Addison-Wesley, Boston, U.S.A. The combination device 5shown in FIG. 1 may perform the data processing, for example.

For example, it is first calculated whether an overlapping region of therespective images exists. If this is the case, the correspondingoverlapping region of the second image data is read out from the datastorage and is prepared for displaying (step S5). The corresponding dataof the second image data are processed before displaying so that thesecond image, which is based on the second image data, can be displayedin the same orientation and scaling as the ultrasound image.

The procedure described before is preferred, if the ultrasound image istwo-dimensional. For 3D-ultrasound image information it is as wellpossible, to choose the orientation (i.e. the angle of the view) of theultrasound image to be shown, in particular to adapt the orientationaccording to other criteria. In any case, it is possible to adapt thescaling of the ultrasound image before displaying. Instead of, oradditionally to displaying, the combined first and second imageinformation may be processed in another way. For example, they can bestored and/or evaluated in a different manner.

1-8. (canceled)
 9. A method for displaying in an image combinationdevice images of an object, comprising: storing second image data of anobject, from which second images can be generated, in a data storagestructure, said second image data detected using a second imagingsystem; transferring, from an ultrasound imaging detector system havingan ultrasound imaging detector to said image combination device, (1)first image data of said object and (2) additional data; wherein saidadditional data comprises at least one of (a) spatial dimension of animage unit of said first image data and (b) orientation of a first imagedefined by said first image data relative to orientation of saidultrasound imaging detector; wherein said first image data is detectedfrom said object by said ultrasound imaging detector and said additionaldata is obtained using said ultrasound imaging detector system; whereinsaid image combination device uses said additional data to determinefrom said second image data at least one of orientation and scale fordisplay of said second images; and displaying, in said image combinationdevice, said second images of said object.
 10. The method of claim 9further comprising storing said additional data in a data storagestructure that is readable by said image combination device.
 11. Themethod of claim 9 wherein said additional data further comprises atleast one of the following: (c) number of image units between two imagefeatures in said first image data; and (d) number of image units betweenan image feature in said first image and said ultrasound imagingdetector.
 12. The method of claim 9 wherein said additional datacomprises both (a) and (b).
 13. The method of claim 9 wherein said imageunit is a pixel and said spatial dimension of an image unit of saidfirst image data is a spatial dimension associated with said pixel. 14.The method of claim 9 further comprising: displaying, in said imagecombination device, first images using said additional data and saidfirst image data, wherein said image combination device uses saidadditional data to maintain constant at least one of said relativeorientation and said ratio of scale, between concurrently displayedfirst and second images.
 15. The method of claim 9 further comprisingtransferring from said ultrasound imaging detector system to said imagecombination device data indicating position of said ultrasound imagingdetector relative to a position sensor.
 16. The method of claim 9further comprising transferring from said ultrasound imaging detectorsystem to said image combination device data indicating identificationof an ultrasound probe of said ultrasound imaging detector system. 17.The method of claim 9 further comprising: selecting a penetration depthfor said first image data by limiting a time for detection of ultrasoundecho signals by said ultrasound imaging detector; determining saidpenetration depth, in said ultrasound imaging detector system; andtransmitting said penetration depth to said combination device.
 18. Themethod of claim 9 further comprising: determining, in said ultrasoundimaging detector system, a width of an image recording area; andtransmitting said width to said combination unit.
 19. An apparatus fordisplaying in an image combination device images of an object,comprising: a data storage structure for storing second image data of anobject from which second images can be generated in, said second imagedata detected using a second imaging system; an ultrasound imagingdetector system having an ultrasound imaging detector for detectingfirst image data of an object and for acquiring associated additionaldata; data transfer structure for transferring from said ultrasoundimaging detector system to said image combination device said firstimage data and said additional data; display structure for displayingsaid second images; wherein said additional data comprises at least oneof (a) spatial dimension of an image unit of said first image data and(b) orientation of a first image defined by said first image datarelative to orientation of said ultrasound imaging detector; whereinsaid image combination device is designed to use said additional dataand said second image data to determine at least one of orientation andscale in display of said second images.
 20. The apparatus of claim 19further comprising a data storage structure that is readable by saidimage combination device for storing said additional data.
 21. Theapparatus of claim 19 wherein said additional data further comprises atleast one of the following: (c) number of image units between two imagefeatures in said first image data; and (d) number of image units betweenan image feature in said first image and said ultrasound imagingdetector.
 22. The apparatus of claim 19 wherein said additional datacomprises both (a) and (b).
 23. The apparatus of claim 19 wherein saidimage unit is a pixel and said spatial dimension of an image unit ofsaid first image data is a spatial dimension associated with said pixel.24. The apparatus of claim 19 further comprising displaying, in saidimage combination device, first images using said additional data andsaid first image data, wherein said image combination device uses saidadditional data to maintain constant at least one of said relativeorientation and said ratio of scale, between concurrently displayedfirst and second images.
 25. The apparatus of claim 19 furthercomprising structure for transferring from said ultrasound imagingdetector system to said image combination device data indicatingposition of said ultrasound imaging detector relative to a positionsensor.
 26. The apparatus of claim 19 further comprising structure fortransferring from said ultrasound imaging detector system to said imagecombination device data indicating identification of an ultrasound probeof said ultrasound imaging detector system.
 27. The apparatus of claim19 further comprising control structure enabling a user to choose aspatial dimension within a range of spatial dimensions of saidultrasound imaging detector.
 28. The apparatus of claim 19 furthercomprising: structure in said ultrasound imaging detector system forselecting a penetration depth for said first image data by limiting atime for detection of ultrasound echo signals by said ultrasound imagingdetector, for determining said penetration depth, and for transmittingsaid penetration depth to said combination device.
 29. The apparatus ofclaim 19 further comprising structure in said ultrasound imagingdetector system for determining, a width of an image recording area andfor transmitting said width to said combination unit.
 30. The apparatusof claim 19 further comprising an additional data connection betweensaid ultrasound imaging detector system and said image combinationdevice for transferring said additional information from said ultrasoundimaging detector system to said image combination device.
 31. Theapparatus of claim 19 further comprising an ultrasound control unit ofsaid ultrasound imaging detector system for inputting control settingsto said ultrasound imaging detector and also for transmitting saidsettings to said image combination device.
 32. The apparatus of claim 31wherein said control settings comprise at least one of penetration depthand range of an ultrasound image.
 33. A method of making an apparatusfor displaying in an image combination device images of an object,comprising: providing a data storage structure for storing second imagedata of an object from which second images can be generated in, saidsecond image data detected using a second imaging system; providing anultrasound imaging detector system having an ultrasound imaging detectorfor detecting first image data of an object and for acquiring associatedadditional data; providing a data transfer structure for transferringfrom said ultrasound imaging detector system to said image combinationdevice said first image data and said additional data; providing adisplay structure for displaying said second images; wherein saidadditional data comprises at least one of (a) spatial dimension of animage unit of said first image data and (b) orientation of a first imagedefined by said first image data relative to orientation of saidultrasound imaging detector; wherein said image combination device isdesigned to use said additional data and said second image data todetermine at least one of orientation and scale in display of saidsecond images.